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ABSTRACT 

Introduction: Minimally invasive endoscopic biopsy 
techniques have been widely available as potential 
alternatives for mediastinal lesions staging in patients 
with known or suspected lung cancer. Previous efforts 
have been made to evaluate the diagnostic 
performance of specific endoscopic modality alone at 
the level of the mediastinum for staging lung cancer, 
however, few studies focus on the accuracy of 
comparisons between different endoscopic modalities, 
especially at the level of any individual lymph node 
station. The objective of our study is to determine the 
diagnostic yields of different endoscopic modalities for 
staging mediastinal lymphadenopathy in lung cancer, 
especially concerning the individual lymph node 
station. 

Methods/design: A systematic electronic search of 
MEDLINE, EMBASE, SinoMed and ISI Web of Science 
were performed to identify studies evaluating 
endoscopic modalities accuracy with restriction of 
English and Chinese languages from inception to an 
update until May 2014. Data were extracted with the 
patient as the unit of analysis with regards to the 
abilities of different endoscopic modalities at the level 
of mediastinum and particular lymph node station. The 
methodological quality was assessed independently 
according to the Quality Assessment of Diagnostic 
Accuracy Study (QADAS) criteria. An exact binomial 
rendition of bivariate mixed-effects regression model 
was used to estimate the pooled sensitivity and 
specificity. Also, pre-post probability analysis, 
publication bias analysis and sensitivity analysis were 
performed for a synthesis of knowledge of this context. 
Dissemination: The findings will advance our better 
available knowledge of optimal clinical decision-making 
when dealing with staging of mediastinal metastasis in 
lung cancer. 

Trial registration number: PROSPERO— NIHR 
Prospective Register of Systematic Reviews 
(CRD4201 4009792). 
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INTRODUCTION 

Lung cancer has the highest morbidity 
among all cancers, with an estimated 



Strengths and limitations of this study 



The systematic review is focused on different 
minimally invasive endoscopic techniques 
designed for use in the setting of lung cancer. 
The systematic review is non-commercial and 
has been elaborated systematically by a multidis- 
ciplinary panel of experts, working on behalf of 
the key stakeholders within a nationalised health- 
care system. 

Any single endoscopic regime cannot be recom 
mended as a definitive test for staging medias- 
tinal lymphadenopathy in lung cancer, but rather 
it must be interpreted in context of the demo- 
graphic and clinical factors, if feasible. 



incidence of over 1.6 million cases/year 
accounting for 13% of all new cancer diag- 
noses; it is also the leading cause of cancer- 
related deaths worldwide, with an estimated 
mortality of over 1.4 million/year, accounting 
for 18% of all cancer deaths. 1 2 

Of crucial importance is accurate diagnosis 
and precise staging of known or suspected 
lung cancer for the clinician to better deter- 
mine treatment, guide prognosis and facili- 
tate continued investigation. 3 Central to the 
diagnostic algorithm is the pathological 
staging in which the evaluation of medias- 
tinal lymph node is a key step for the man- 
agement of patients with lung cancer, 
especially in the absence of distant 
metastases. 4 5 

Non-invasive imaging scans involving CT, 
positron emission tomography (PET) and 
the integrated PET/CT, 6 7 are considered 
favourable for staging mediastinal lymph 
nodes due to the morphological and func- 
tional characteristics of the lesions. 8 9 
However, more precise information on 
staging and typing is required for clinical 
decision-making. 10 

Mediastinoscopy and thoracoscopy have 
been recommended as diagnostic standards 
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for staging along with histopathological validation of sus- 
pected mediastinal lymph nodes involvements. 11 12 
Considering the extensive invasiveness and general 
anaesthesia, these tests are likely at a high risk of 
procedure-related complications with a reported inci- 
dence rate in the order of 2-3%. 13 Conversely, the inva- 
sive nature has led to an increasing interest in the 
development of more technically flexible, efficient and 
minimally invasive modalities coupled with comparable 
diagnostic yields. 

With the advent of endoscopic biopsy techniques, the 
diagnostic algorithm for staging lung cancer has evolved 
into the minimally invasive stage. 14 15 Ideally, endobron- 
chial ultrasound (EBUS) and endoscopic ultrasound 
(EUS) to guide transbronchial needle aspiration (TBNA) 
have been suggested for diagnosing and staging of medias- 
tinal lesions in lung cancer. 16-18 These endoscopic techni- 
ques have the significant advantages of being less invasive 
and with fewer complications, and have the potential to be 
reasonable alternatives to invasive staging modalities in 
certain populations, 19-21 in addition to those of cytopatho- 
logical phenotyping as well as molecular profiling for 
genotyping of lung cancer over non-invasive modalities. 22 

Previous efforts have been made to evaluate the diag- 
nostic performance of specific endoscopic modality 
alone at the level of the mediastinum for staging lung 
cancer, 23-30 however, few studies focus on the accuracy 
of comparisons between different endoscopic modal- 
ities, especially at the level of any individual lymph node 
station. Also, they call into question the possible associ- 
ation of the demographic and clinical confounders with 
the diagnostic accuracy of endoscopic modalities for 
diagnosis and staging of lung cancer. 31 

Given that a considerable need for a comprehensive 
systematic review has been triggered to synthesise the 
currently available bulk of information, the objective of 
this study is to ascertain the diagnostic yields of different 
minimally invasive endoscopic modalities for staging 
mediastinal lymphadenopathy in lung cancer, especially 
concerning the individual lymph node station. 

METHODS 

Conception and design 

The design of this systematic review was elaborated by 
the multidisciplinary efforts (eg, cardio thoracic surgery, 
ultrasonography, radiation oncology, diagnostic medi- 
cine and health statistics) using methodological 
approaches outlined in the Cochrane Handbook for 
Systematic Review of Diagnostic Test Accuracy. 32 This 
protocol refers to the Preferred Reporting Items for 
Systematic reviews and Meta-Analyses (PRISMA) cri- 
teria. 33 This systematic review has been registered with 
No. CRD4201 4009792 in the Centre of Review and 
Dissemination (CRD) of York University, PROSPERO 
(the National Institute for Health Research (NIHR) 
International Prospective Register of Systematic 
Reviews) . 



Eligibility criteria for considering studies 

Eligible articles will be identified in accordance with the 
PICOS criteria 33 : Participants ( pretreatment patients 
with suspected or previously diagnosed lung cancer for 
staging of mediastinal lymph nodes); Interventions 
(minimally invasive endoscopic techniques: TBNA, 
EUS-TBNA and EBUS-TBNA); Comparisons (histo- 
pathological validation following mediastinoscopy and 
surgery or close clinical follow-up for at least 6 months); 
Outcomes (diagnostic sensitivity, specificity, ORs and 
likelihood ratio) and Study design (any prospective 
cohort and case-control study) . 

Search for identification of studies 

In addition to Cochrane Central databases (including 
the Cochrane Database of Systematic Reviews, the 
Cochrane Central Register of Controlled Trials, the 
Cochrane Methodology Register, the Database of 
Abstracts of Reviews of Effects, the Health Technology 
Assessment Database and the National Health Service 
(NHS) Economic Evaluation Database), a systematic 
electronic literature search of MEDLINE, EMBASE, 
SinoMed and ISI Web of Science will be performed to 
identify studies that have evaluated the accuracy of endo- 
scopic techniques compared with reference standards in 
pretreatment patients with suspected or known lung 
cancer for staging of mediastinal lymph nodes; these 
studies will be eligible for inclusion. Search will be 
limited to articles published in English and Chinese, 
from inception to an update until May 2014. BIOSIS will 
be used to identify relevant abstracts and conference 
proceedings, and abstracts and conference proceedings 
will be included if appropriate. A combination of subject 
headings and text words will be used for search on the 
basis of three sets of terms: index tests (minimally inva- 
sive techniques aforementioned), target condition (sus- 
pected or known lung cancer for staging of mediastinal 
lymph nodes) and participants description (pretreat- 
ment patients with suspected or known lung cancer). 
Through the process of search, no filter will be used for 
diagnostic studies to maximise the sensitivity of the 
search strategies. Further relevant articles will be 
retrieved for recall completion by searching the bibliog- 
raphy of identified trials as well as other related system- 
atic and narrative reviews. 

Search strategy 

Specific search strategy will be developed for each elec- 
tronic database, commencing with MEDLINE (table 1). 
The MEDLINE strategy will be adapted for each subse- 
quent database and search yields reported and com- 
pared between databases. 

Study screening 

The primary, subsequent and conclusive screening for 
inclusion will be on the basis of the article title, abstract 
and full text, respectively. The screening at each step will 
adhere to the same inclusion and exclusion criteria. At 
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Table 1 Searching strategies of the Medline database (results from 14 May 2014) 



Specified item 





Oi ion/ 
uuci y 


□pel lit 


#1 


"Lung Neoplasms"[Mesh] 


170510 


#2 


("lung"[tw] OR pulmonary[tw]) 


924 000 


#3 


(neoplasm*[tw] OR cancer*[tw] OR tumor*[tw] OR carcinoma*[tw] OR neoplasia* 


2 207 899 




[tw] OR malignan*[tw]) 




#4 


"neoplasm staging"[MeSH Terms] 


119312 


#5 


Stagepw] OR stagespw] OR stagingpw] 


806 735 


#6 


("humans"[MeSH] OR human*[tw]) NOT ("animals"[MeSH] OR animal*[tw]) 


11 775 100 


#7 


("endosonography"[MeSH] OR "ultrasonography, interventional" [MeSH]) AND 


4989 




"biopsy"[MeSH] 




#8 


"Endoscopic Ultrasound-Guided Fine Needle Aspiration"[MeSH] 


385 


#9 


biops*[tw] OR aspirat*[tw] OR punct*[tw] 


498 201 


#10 


endobronch*[tw] OR transbronch*[tw] OR (intervention*[tw] AND bronch*[tw]) 


12 851 


#11 


endosonograph*[tw] 


9756 


#12 


Endoscop*[tw] 


169 758 


#13 


Ultrasonography[MeSH] OR ultrasound*[tw] OR *sonogra*[tw] OR *ultrason*[tw] 


490 594 




OR echograph*[tw] OR Echo[tw] 




#14 


#1 OR (#2 AND #3) 


224 785 


#15 


(#3 AND #5) OR #4 


119312 


#16 


#14 AND #15 


16 683 


#17 


#6 AND #16 


16 406 


#18 


#9 AND #10 AND #11 


405 


#19 


#9 AND #10 AND #12 AND #13 


291 


#20 


#7 OR #8 OR #18 OR #19 


5133 


#21 


#17 AND #20 


364 



Target condition 
set 



Patient 

description set 
Index tests set 



the first step, a single author will exclude studies clearly 
irrelevant to lung cancer or endoscopic staging for medi- 
astinal lymphadenopathy in terms of the abstracts and 
titles. In case of selection bias, a 10% random sample of 
all potential references will be validated by a second 
author for agreement. A further screening will be con- 
ducted by at least two independent reviewers for each 
article reserved after the first step. Definite inclusion 
decision will be made on the basis of full text of relevant 
reports by two independent reviewers. Disagreements 
will be resolved by discussion and consultation with the 
aid of a third reviewer, if required. 

Inclusion criteria 

Population and target condition: The study population 
was patients either suspected or with known lung cancer 
who received endoscopic staging for mediastinal 
lymphadenopathy. 

Index tests and reference standard: Patients were 
staged based on at least one minimally invasive endo- 
scopic technique (eg, TBNA, EUS-TBNA and 
EBUS-TBNA), which should be compared with at least 
one of the reference standards (eg, tissue histological 
confirmation of mediastinoscopy and surgery or close 
clinical follow-up for at least 6 months) , irrespective of 
availability of imaging-based staging before endoscopic 
techniques. 



Exclusion criteria 

Studies focusing especially on mediastinal node staging 
alone; studies consisting of patients with primary under- 
lying disease other than lung cancer; studies unable to 
populate two-by-two contingency tables of test perform- 
ance (absolute numbers of true-positive, false-negative, 
false-positive and true-negative results) from the text, 
appendices or despite contacting the authors; studies of 
sample sizes of less than 15 patients; studies of restaging 
after induction therapy; studies where the positive 
results from index tests were scarcely confirmed by any 
reference standard; and studies where duplicates or sub- 
cohorts have already been published. At least two inde- 
pendent reviewers will assess the papers for inclusion 
and exclusion criteria. 

Data extraction 

The clinical, demographic and methodological quality 
characteristics of the reference and index tests, as well as 
the diagnostic results (eg, true positives, true negatives, 
false positives and false negatives), will be extracted inde- 
pendently by two reviews. An in-depth discussion of the 
variability between studies will be provided where applic- 
able. If possible, data for endoscopic biopsies performed 
at hilar, subcarinal, paratracheal or other lymph node 
stations will be extracted separately. Additional data were 
requested from original study investigators, if needed. In 
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addition, the publication year, the study period, setting 
(eg, community vs academic hospitals; and primary vs 
tertiary centres), design (eg, cohort or case-control; and 
consecutive or random series), centre (eg, single or mul- 
tiple), potential differences in reference standards, 
follow-up period and prevalence of mediastinal metasta- 
ses will be described as covariates that may be the cause 
of heterogeneity. Two reviewers will independently 
extract data. Any disagreements will be resolved by 
consensus. 

Assessment of methodological quality 

In terms of the risk of bias and applicability concerns, 
the methodological quality of the articles included will 
be independently assessed by two reviewers using a 
subset of criteria derived from the Quality Assessment of 
Diagnostic Accuracy Study 2 (QUADAS-2) tool. 34 A third 
reviewer will be consulted in case of discrepancies. 
Blinding implies that the results of minimally invasive 
endoscopic staging results must be interpreted without 
the knowledge of those of reference standards. 
Reviewers' judgments about risks of bias and applicabil- 
ity concerns will be used in sensitivity analysis to deter- 
minate the potential effect of methodological quality on 
diagnostic performance. Two reviewers will independ- 
ently assess study quality. Any disagreements will be 
resolved by consensus. 

Data synthesis and analysis 

For each study we will collect the rates of true positives, 
false positives, true negatives and false negatives and 
produce from the crude data the sensitivity and specifi- 
city. In addition to the diagnostic accuracy of different 
endoscopic modalities for staging total mediastinal 
lymphadenopathy, we will shed some light on the accur- 
acy for individual lymph node station and the lesions in 
different compartments of the mediastinum. A bivariate 
mixed-effects regression model will be used to generate 
the pooled estimates of sensitivity and specificity when 
appropriate. 35 Meanwhile, summary receiver operating 
characteristic (SROC) curves with the corresponding 
area under the curve (AUC) will also be graphically gen- 
erated to determinate the diagnostic accuracy, in which 
a summary operating point ( pooled sensitivity and speci- 
ficity) with the corresponding 95% CI and 95% predic- 
tion region, and the point Q* (maximum joint 
sensitivity and specificity) will also be calculated in add- 
ition to the point estimates for each study as well as a 
symmetrical summary curve. Comparison of diagnostic 
accuracy between the groups will be achieved by Z test 
on the basis of AUC of SROC. 

Threshold analysis 

Spearmans rank correlation will be performed for 
exploring the effect of threshold effect. To ensure the 
effect of variability in diagnostic threshold on the shape 
of SROC curve, threshold effect will be detected by the 
regression equation D=a+bS, where D is the log of the 



diagnostic OR and S is a measure of the diagnostic 
threshold. 36 37 The variables a and b will then be esti- 
mated using a least-squares method weighted by inverse 
variance. 

Heterogeneity investigation 

The expected heterogeneity across studies will be 
detected by the meta-regression analysis and subgroup 
analysis. The pattern of heterogeneity will be detected 
using % 2 test and the magnitude using I 2 statistic. A study 
with an I 2 greater than 50% will be considered substan- 
tially heterogenous. 38 

Meta-regression analysis 

Meta-regression will be performed to evaluate the 
importance of potential effect variables and explain vari- 
ation between studies. Univariate analysis will allow the 
investigation of the potential source of statistical hetero- 
geneity. Subsequently, multivariate analysis will allow the 
determination of the important confounders affecting 
the diagnostic performance by the method of backward 
elimination. The covariates are consisted with the demo- 
graphic, clinical and endoscopic characteristics. 

Subgroup analysis 

To explore clinical heterogeneity, we will fit a separate 
SROC curve for these planned subgroups of patients: 
(1) different anatomic compartments of the mediasti- 
num (superior vs middle vs inferior mediastinum); (2) 
different types of endoscopic techniques (TBNA vs 
EUS-TBNA vs EBUS-TBNA vs incorporation of the 
modalities); (3) different populations (known vs sus- 
pected mediastinal lymph node involvement; with vs 
without the distant metastasis) and (4) sequential 
imaging (with vs without imaging scans before the 
implement of endoscopic techniques. 

Probability analysis 

The pretest probabilities of different prevalences of 
mediastinal metastases among patients suffering from 
lung cancer and corresponding post-test probabilities 
will be evaluated, depending on the summary sensitivity 
and specificity by Fagans analysis, 39 which will allow the 
determination of the relationship between the pretest 
and post-test probability as well as the likelihood ratio. 
The difference in the proportions of mediastinal lymph- 
adenopathy in lung cancer (post-test probability minus 
pretest probability) will gave the overall added value of 
endoscopic staging. 

Publication bias 

Publication bias will be examined visually by inspecting 
funnel plots and statistically by using Eggers regression 
model. 40 If publication bias was present, the effect of 
such bias on the summary estimate would be assessed 
using the trim and fill method. This method will impute 
the missing studies and recalculate a new summary esti- 
mate. 41 The difference between the calculated and 
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observed value will be then used to determine the effect 
of bias on the diagnostic performance of the index tests. 

Post-hoc power analysis 

The technique of power analysis allows for the determin- 
ation of how likely a statistical test of an individual study 
will be to detect effects of a given sample size in a par- 
ticular situation. The determination of post-hoc power 
for testing differences in proportions for the matched 
pair design with binary response outcome will be per- 
formed for each study included, according to the 
formula derived by Lachin. 42 

Sensitivity analysis 

For detecting the robustness of pooled results, sensitivity 
analysis will be performed to determine the potential 
impacts of study design on endoscopic staging accur- 
acy. 43 On the basis of QUADAS-2, the important follow- 
ing sensitivity analyses will be prespecified: risk of 
selection bias, risk of interpretation bias for the index 
tests as well as reference standards. 34 

All the analyses will be conducted using MADIS module of 
Stata VI 0 (Stata Corp, College Station, Texas, USA), except 
for publication bias using Meta-Analyst (3 3.13 (Tufts Medical 
Center, Boston, Massachusetts, USA), and meta-regression 
and threshold analysis using Meta-DiSc VI. 4 (Clinical 
Biostatistics Unit, Ramon y Cajal Hospital, Madrid, Spain) . 

DISCUSSION 

The problem-oriented research will enable the best avail- 
able knowledge of clinical practice, on the strength of 
comprehensively rigorous methodology used in the 
review. The internal validation and navigation involved 
in the process will minimise the potential of selection 
bias and systematic errors. On the basis of a synthesis of 
methodological quality estimation for each study 
included, the findings will be available for a further sub- 
group analysis to explore potential methodological het- 
erogeneity. Considering the high dependence of the 
findings on the quality of the underlying primary 
studies, as well as the potential risk of bias from limited 
quality studies on clinical practice, only the prospective 
studies will be included in our current review in order to 
provide more convincing evidence. 

The findings of this systematic review will provide 
important evidence for endoscopic staging for medias- 
tinal lymphadenopathy in lung cancer, as well as enable 
optimal clinical decision-making when involved in 
staging for mediastinal lymph node involvement. The 
findings will also help to better advance our available 
knowledge of the management strategy in individualised, 
targeted and comprehensive treatment of, as well as 
aiding in the determination of prognosis among, 
patients suffering from lung cancer. Furthermore, the 
findings may trigger an update or drive the development 
of related standards, which will lead to refine medias- 
tinal staging in lung cancer. 



To our knowledge, the current review will allow the 
diagnostic accuracy of different endoscopic staging for 
mediastinal lymphadenopathy in lung cancer, for the 
first time, from an overall level to the individual node 
station level, on the basis of evidence-based research. 
Given that we focus on results from practice and empha- 
sise outcomes evaluation, the results from this review will 
put forth the advantages and disadvantages in medical 
practice of using minimally invasive endoscopic biopsy 
in staging mediastinal lymphadenopathy in lung cancer, 
and will lay the foundation for further research and the 
development of establishing optimal staging pathways 
for patient subgroups. 
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